CLIPVG: Text-Guided Image Manipulation Using Differentiable Vector Graphics

نویسندگان

چکیده

Considerable progress has recently been made in leveraging CLIP (Contrastive Language-Image Pre-Training) models for text-guided image manipulation. However, all existing works rely on additional generative to ensure the quality of results, because alone cannot provide enough guidance information fine-scale pixel-level changes. In this paper, we introduce CLIPVG, a manipulation framework using differentiable vector graphics, which is also first CLIP-based general that does not require any models. We demonstrate CLIPVG can only achieve state-of-art performance both semantic correctness and synthesis quality, but flexible support various applications far beyond capability methods.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Retrieving Vector Graphics Using Sketches

In this paper we present an approach to allow indexing and retrieving vector graphics by content, using topological and geometric information automatically extracted from figures. The method described retrieves WMF ClipArt files as an instance of the general problem of searching vector drawings. Our prototype can already handle databases with thousands of drawings using commodity hardware. Our ...

متن کامل

Text-Guided Attention Model for Image Captioning

Visual attention plays an important role to understand images and demonstrates its effectiveness in generating natural language descriptions of images. On the other hand, recent studies show that language associated with an image can steer visual attention in the scene during our cognitive process. Inspired by this, we introduce a text-guided attention model for image captioning, which learns t...

متن کامل

Evolving Pop Art Using Scalable Vector Graphics

In this paper we present our findings of our continued investigation into the use of Scalable Vector Graphics as a genotype representation in evolutionary art. In previous work we investigated the feasibility of SVG as a genetic representation for evolutionary art, and found that the representation was very flexible, but that the potential visual output was somewhat limited by the simplicity of...

متن کامل

Using scalable vector graphics to evolve art

In this paper we describe our investigations of the use of Scalable Vector Graphics as a genotype representation in evolutionary art. We describe the technical aspects of using SVG in evolutionary art, and explain the genetic operators mutation and crossover. Furthermore, we compare the use of SVG with existing representations in evolutionary art. We perform two series of experiments and descri...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i2.25326